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DESCRIPTION 

Three -Dimensional Survey System and Electronic Storage 
Medium 

Technical Field 

The present invention relates to three-dimensional 
survey systems (and like systems) for computing three- 
dimensional coordinate data using a survey apparatus and 
image acquisition devices, and more particularly, to a 
three-dimensional survey system capable of making 
stereographic displays by determining positions of tie 
points using a survey apparatus. 

Background Art 

In conventional methods, image acquisition means 
(for example, digital cameras) and a reference structure of 
known dimensions are used to obtain three-dimensional 
coordinates from image data. The reference structure is 
rested near the object to be selected as a measurement 
target, and images of this reference structure are acquired 
from two or more directions with the cameras. These 
cameras have an inclinometer for measuring 

longitudinal/lateral inclinations of images. . The reference 
structure is of known dimensions, and for example, a 
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triangular structure is used as the reference structure. 
Previously surveyed positions are selected as camera- 
photographing positions and a position at which the 
reference structure is to be rested. 

Photographing from the above photographing positions 
is conducted in the composition where an image of the 
object selected as the measurement target, and an image of 
the reference structure will be formed at the same time. 
The relationship between the reference structure, the 
photographing position, and the position on the acquired 
image, is derived by absolute orientation, and three- 
dimensional coordinates of the object as the measurement 
target, are calculated. 

However, a reference structure of known dimensions, 
or the like, must be installed beforehand to conduct the 
above absolute orientation in the conventional methods. 
Also, the installation position for the reference structure 
and the camera -photographing positions must be surveyed. 
There have been the problems that it is very troublesome to 
perform surveys as well as to place the reference structure 
and install the cameras, and that if the structure is a 
building, it is usually very large and requires much more 
troublesome operations. Additionally, there have been the 
problems that before a photographing altitude can be 
measured, an inclinometer for detecting inclinations must 
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be provided on the camera, and that a special camera that 
permits this is extremely expensive. 

Disclosure of Invention 

The present invention was made with the above 
problems in view, and the invention has a survey apparatus 
for measuring a position of a collimation target from 
distance and angle data, and image acquisition devices each 
for acquiring images of an object to be measured, inclusive 
of an image of the collimation target, from different 
plural directions. The present invention further includes: 
arithmetic processing means that matches, by using the 
collimation target as a tie point, the images that have 
been acquired by the image acquisition devices, relates the 
collimation target position that has been measured by the 
survey apparatus, and the collimation target in each of the 
matched images, and computes three-dimensional coordinate 
data of the object to be measured, in accordance with 
above-related data. 

The present invention can also be constructed so 
that: the survey apparatus placed at a known point measures 
positions of at least six collimation targets, and the 
arithmetic processing means conducts corrections for 
inclinations or rotational angle errors of the image 
acquisition devices, calculates positions of the image 



acquisition devices from the position of the collimation 
target and the images acquired from the image acquisition 
devices, and- computes three-dimensional coordinate data of 
the object to be measured, the coordinate data having been 
acquired by the image acquisition devices. 

Additionally, the collimation target (s) in the 
present invention can be formed of a retroref lective 
material and constructed so that a mark that facilitates 
collimation is formed on the surface of the material. 

Furthermore, the present invention can be a three- 
dimensional survey apparatus in which the mark is 
constituted by a marker section identifiable from image 
data of image acquisition devices, and by a symbol that an 
operator can identify. 

Moreover, the mark in the present invention can also 
be constituted by the cross hairs that facilitate 
collimation, a visually identifiable character, and an 
electrically readable code. 

The visually identifiable character can be made into 
a numeric one, and the electrically readable code into a 
bar code . squi 11. 

Furthermore, a three-dimensional survey method 
according to the present invention includes: a first 
process step of measuring a position of a collimation 
target from distance data and angle data by means of a 
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survey apparatus; a second process step of acquiring images 
of an object, inclusive of an image of the collimation 
target, from different directions by using a plurality of 
image acquisition devices; a third process step of matching, 
by using the collimation target as a tie point, the images 
acquired by the image acquisition devices; a fourth process 
step of relating the collimation target position measured 
by the survey apparatus in the first process step, and the 
collimation target in each of the matched images; and a 
fifth process step of computing three-dimensional 
coordinate data on the object to be measured, in accordance 
with the data related in the fourth process step. 

Furthermore, a three-dimensional survey system 
according to the present invention includes: a survey 
apparatus for measuring a position of a collimation target 
from distance and angle data and acquiring images of an 
object, inclusive of an image of the collimation target; 
image acquisition devices each for acquiring imaged of an 
object to be measured, inclusive of an image of the 
collimation target, "from different plural directions; and 
arithmetic processing means that matches the images that 
have been acquired by the survey apparatus, and the images 
that have been acquired by the image acquisition devices, 
further matches, by using the collimation target as a tie 
point, the images acquired by the image acquisition devices. 
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relates the collimation target position that has been 
measured by the survey apparatus, and the collimation 
target in each of the matched images, and computes three- 
dimensional coordinate data of the object to be measured, 
in accordance with above-related data. 

Furthermore, an electronic storage medium according 
to the present invention is constructed to have a program 
stored inside to lay down procedural steps of : reading both 
distance data and angle data on the collimation target 
measured by a survey apparatus; reading image data 
inclusive of the collimation target photographed from 
different directions by a plurality of image acquisition 
devices; matching the images acquired by the survey 
apparatus, and the images acquired by the image acquisition 
devices; further matching, by use of the collimation target 
as a tie point, the images acquired by the image 
acquisition devices; relating the collimation target 
position measured by the survey apparatus, and the 
collimation target in each of the matched images; and 
computing three-dimensional coordinate data of the object 
to be measured, in accordance with above-related target 
data. 

Brief Description of Drawings 

Fig. 1 is a diagram explaining a first embodiment of 
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the present invention. Fig. 2 is another diagram 
explaining the first embodiment of the present invention. 
Fig. 3 is a diagram explaining a target mark 2000 in the 
first embodiment. Fig. 4 is a diagram explaining a survey 
machine 1000 in the first embodiment. Fig. 5 is a diagram 
explaining a configuration of the survey machine 1000 in 
the first embodiment. Fig. 6 is a diagram explaining a 
second embodiment of the present invention. Fig. 7 is 
another diagram explaining the second embodiment of the 
present invention. Fig. 8 is a diagram explaining a 
configuration of the survey machine 1000 used in the second 
embodiment. Fig. 9 is a diagram that explains operation of 
the second embodiment . 

Best Mode for Carrying out the Invention 
[ Embodiment s ] 

Embodiments of the present invention are described 
hereunder in accordance with the accompanying drawings. 
( First Embodiment ) 

A first embodiment is a three-dimensional survey 
system that uses target marks 2000 as pass points. 

A total station that can measure distances up to 
reflection prisms placed at land survey points is used as a 
survey machine 1000. Also, the target marks 2000 are used 
that are drawn on a reflection sheet so that the marks can 
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be used as pass points of stereographic images and instead 
of reflection prisms. 

The first embodiment is described below using Fig. 1. 

A target mark 2000a, 2000b, 2000c, 2000d, 2000e, or 
2000f is rested in or attached (using an adhesive or the 
like) to at least six positions on an object to be measured 
(hereinafter, referred to as the measurement target 10000) . 
The six positions are taken as pass points of the 
measurement target 10000. 

For stereographing from any two lateral positions, 
cameras are rotated longitudinally and laterally from 
respective centers of the cameras, i.e., in directions of 
three optical axes (X-axis, Y-axis, and Z-axis) . The 
resulting inclinations of the cameras are expressed as ( co, 
(j), Ki roll, pitch, and yaw, respectively) . 

To solve these parameters as variables, six pass 
points that are mathematically known are required. 

Next, a survey machine 1000 is installed at a known 
point distant from the measurement target 10000, the known 
point being a position at which the target marks 2000 are 
to be measured. The known point in this case is a point 
derived by use of a GPS -equipped device, survey datum 
points, and/or the like, and having a coordinate position 
inclusive of height.' 

A tripod is placed on the known point, then the 



survey machine 1000 is installed on the tripod, and machine 
height is measured. The machine height is an actual height 
for surveying . 

A second known point is collimated with the survey 
machine 1000, and this point is taken as a datum point for 
measuring a horizontal angle. After the collimation, the 
target marks 200 0a to 2000f are collimated and then 
surveyed to obtain horizontal angles, altitude angles, and 
distances between the target marks. 

Coordinate positions of the target marks 2000a to 
2000f are determined by the distance from the known point 
at which the survey machine 1000 is installed, to the 
second known point, distances from the known point to each 
of the target marks 2000a to 2000f, and the respective 
horizontal angles and altitude angles from the datum point. 

Next, as shown in Fig. 2, the target marks 2 0 00a to 
20 oof, together with the measurement target 100 00, are 
photographed from at least two directions (left/right) 
using digital cameras 3000. 

Relative orientation for deriving a relationship in 
relative position between the digital cameras 3000 that 
have acquired images from the left/right directions is 
conducted with the target marks 2000a to 2000f as pass 
points . 

During the relative orientation, the relationship in 
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relative position between the digital cameras 3000 that 
have acquired the left/right images can be derived by 
specifying tie points (pass points) of the left/right 
images. This makes it possible to define a three- 
dimensional coordinate system with an optical axis of the 
left camera as its center, and hence to define a three- 
dimensional coordinate system with an optical axis of one 
digital camera 3000 as its center. 

The coordinate positions of the pass points that 
were obtained during surveying with the survey machine 1000 
are assigned to the model coordinate system that was 
obtained from the relative orientation, and then this model 
coordinate system is transformed into a terrestrial 
coordinate system by conducting absolute orientation. 

The absolute orientation here is an operation of 
transforming the model coordinate system that was obtained 
from the relative orientation, into a terrestrial 
coordinate system. The transformation can be conducted by 
assigning terrestrially measured three-dimensional 
coordinate data to the points on the images . 

The photographs that were obtained using the digital 
cameras 3 00 0 are central projection photographs whose 
centers and peripheries differ in scaling coefficient. 
After absolute orientation, the resulting images are 
transformed into ortho- images that are parallel projected 
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images . 

The ortho- images are described here. Whereas the 
camera-obtained photographs are central projection 
photographs, the central projection photographs further 
generated by oblique orthogonal projection are called 
orthophotos . Each of the central projection photographs 
was obtained through a lens. Unlike a scale of a map, 
therefore, that of the entire photograph is not uniform. 
The orthophotos, however, are uniform in scale since they 
were generated by oblique orthogonal projection, and can 
therefore be handled similarly to maps. 

The images acquired by the digital cameras 3000 are 
constructed from data of small pixel units, and coordinates 
are assigned to each of the pixels by relative orientation 
and absolute orientation. Two-dimensional displays on a 
display apparatus or the like are shaded according to 
three-dimensional coordinates. During coordinate 
conversion, coordinates in pixel units are newly calculated 
and then displayed in the form of operation such as 
rotation. 

As described above, the present first embodiment 
relates to a three-dimensional survey system capable of 
making stereographic displays by computing three- 
dimensional coordinate data with the survey machine 1000 
and the digital cameras 3000. 
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One example of a relationship between data measured 
by the survey machine 1000, and an image acquired by one 
digital camera 3000, is described below. 

(Formula 1) 

aii(X - Xc) + a^^iY - Yc) + a^^{Z - Zc) 



X = -f 
y = -f 



a3i{X - Xc) + a32(Y - Yc) + a^^iZ - Zc) 
a^iiX - Xc) + a^^jY - Yc) + a23(Z - Zc) 



a3i(X - Xc) + a32(Y - Yc) + a33(Z - Zc) 
where "f" is a focal distance of the digital camera 3000, 
"a" is ( CO, <l>, Ki roll, pitch, and yaw, respectively) that 
denotes an inclination (rotational angles of three axes) of 
the digital camera 3000, "(X, Y, Z) " is three-dimensional 
data measured by the survey machine 1000, and "(Xc, Yc, 
Zc) " denotes position coordinates of the digital camera 
3000 with respect to the survey machine 1000. 

Fig. 3 is an enlarged view of the target mark 2000. 
A base thereof is constructed of a retroref lective sheet. 
The cross hairs 210 0 denoting a collimation point, and a 
circle with the cross hairs in its center, also for 
facilitating collimation, are drawn on the sheet. Above 
the circle is drawn a bar code 22 00 to make this code 
easily readable when the target mark is transformed into an 
image. A numeric character 2300 for a measuring person to 
identify the target mark 2000 is drawn below the circle. 

An adhesive is attached to the reverse of the target 
mark 2000 so that the mark itself can be attached to any 
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object to be measured. A method of installing the target 
mark, can be combined with 'a method other than adhesive 
usage. For example, the target mark can be attached to a 
magnet on the sheet . 

The target mark 2000 is associated with a 
collimation target, and the circle with the cross hairs 
2100 in its center is equivalent to a mark that facilitates 
collimation . 

The bar code 2200 is equivalent to a marker section 
identifiable from image data of the image acquisition 
device, and the numeric character 23 00 corresponds to a 
symbol that an operator can identify. The bar code 2200 is 
further equivalent to an electrically readable code. 

As shown in Figs. 4 and 5, the survey machine 1000 
is a total station, containing an electronic theodolite for 
vertical and horizontal angle detection, and an electro- 
optical range finder. 

In the present embodiment, the survey machine 10 0 0 
and the digital cameras 3 000 are constructed as independent 
bodies. 

Next, an electrical configuration of the survey 
machine 1000 in the present embodiment is described below 
in accordance with Fig. 5. 

The survey machine 1000 includes a distance- 
measuring unit 1100, an angle-measuring unit 14 00, a 
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Storage unit 4200, a display unit 4300, a driving unit 4400, 
a control and arithmetic unit 4000, and an operations/ input 
unit 5000. The storage unit 4200 is for storing data, 
programs, and the like. Using the display unit 4300 and 
the operations /input unit 5000 allows a user to operate the 
survey machine 1000. 

An electro-optical range finder is used as the 
distance-measuring unit 1100. The distance-measuring unit 
1100 measures a distance to a distance-measurement target 
from a phase difference, arrival time difference, and other 
factors of reflected light. The distance-measuring unit 
1100 has a light-emitting section 1110 and a light- 
receiving section 1120, and distance-measuring light from 
the light -emit ting section 1110 is emitted in a direction 
of an object to be measured. The . distance-measuring unit 
1100 is constructed so that the light reflected from the 
object to be measured will enter the light-receiving 
section 1120, whereby the distance to the object to be 
measured is measurable. 

More specifically, the distance from the survey 
machine 1000 to the object to be measured is calculated 
from a differential time from emission of pulse light from 
the light-emitting section 1110, to reception of the light 
by the light-receiving section 1120. The calculation is 
conducted within the control and arithmetic unit 4000. 
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The angle-measuring unit 1400 is for calculating a 
horizontal angle and a vertical angle, and includes a 
vertical-angle measuring section 1410 and a horizontal- 
angle measuring section 1420. 

The vertical -angle measuring section 1410 can use a 
vertical-angle encoder, for example, to detect the quantity 
of vertical rotation from a horizontal or zenith direction. 
The horizontal-angle measuring section 1420 can use a 
horizontal-angle encoder, for example, to detect the 
quantity of horizontal rotation from a reference direction. 
These encoders are both constituted by, for example, a 
rotor installed at a pivotal section, and a stator formed 
at a fixed section. 

The angle-measuring unit 14 00 that includes the 
vertical-angle measuring section 1410 and the horizontal- 
angle measuring section 1420 is adapted to calculate 
horizontal and vertical angles from detected quantities of 
horizontal rotation and of vertical rotation. 

The driving unit 44 0 0 includes a horizontal drive 
4410 and a vertical "drive 4420, and can rotate the survey 
machine 1000 in both horizontal and vertical directions via 
respective motors , 

The control and arithmetic unit 4000 includes a CPU 
and others, and performs various arithmetic operations. 

A program in which is prestored a computing 
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procedure that an arithmetic section 13 0 0 of the survey 
machine 1000 is to use can be stored onto an electronic 
storage medium such as an FD, CD, DVD, RAM, ROM, or memory 
card. 

The survey machine 1000, as shown in Fig. 4, 
includes a telescope 4, a mounting frame 3 that supports 
the telescope 4 in such a form as to enable its vertical 
rotation, and a base 2 that supports the mounting frame 3 
in such a form as to enable its horizontal rotation. The 
base 2 is installable on a tripod or the like, via a 
leveling base 1. 

The survey machine 1000 has an operations panel 
formed as part of the operations/ input unit 5000, and a 
display forming part of the display unit 4300. Furthermore, 
the telescope 4 has an exposed objective lens. 
(Second Embodiment) 

A second embodiment not using target marks 2 00 0 as 
pass points, is described per Figs. 6 and 7. The second 
embodiment, unlike the first embodiment, has an image 
acquisition device 100 in a survey machine 1000. 

The survey machine 1000 can use the image 
acquisition vdevice 100 to acquire images of an object 
present in a collimating direction. A non-prism function 
that captures direct reflections from natural objects and 
does not require a reflection prism is used as a distance- 
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measuring function of the survey machine 1000. 

As shown in Figs. 6 and 7, the survey machine 1000 
collimates any section of an object to be measured, 
measures a distance to that section, and similarly measures 
a horizontal angle and a vertical angle. The image 
acquisition device 100 then acquires an image of a location 
to be surveyed. Since a collimation point is the center of 
an optical axis, the collimation point agrees with the 
center of the image. Survey values and images of at least 
six positions are acquired since the location to be 
surveyed forms a pass point. 

After the surveys, images are acquired from at least 
two directions using digital cameras 3000, as in the first 
embodiment . 

Next, acquired images are matched between the 
digital cameras 3000 and the survey machine 1000. The 
images are matched by conducting corrections in terms of 
scaling coefficient, grayscale level, and rotational angle, 
and associated collimation positions are determined as pass 
points of the camera images . 

The determination of the pass points is followed by 
relative orientation for deriving a relationship in 
relative position between the digital cameras 3 000 that 
acquired the images from the respective (left/right) 
directions. As in the first embodiment, coordinate 
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positions of the pass points which were obtained during 
surveying with the survey machine 1000 are added and after 
absolute orientation, the resulting images are transformed 
into or tho - images . 

The image acquisition device 100 used to transform 
imaging device data into digital data. The image 
acquisition device 100 is for example, a solid-state image 
pickup device such as a CCD. The image acquisition device 
100 includes an image pickup element 110 constructed by a 
CCD and/or other elements, and an imaging circuit 120 that 
forms image signals from output signals of the image pickup 
element 110. 

Next, an electrical configuration of the survey 
machine 1000 in the present embodiment is described below 
in accordance with Fig. 8. 

The survey machine 10 0 0 includes an image 
acquisition device 100, a distance-measuring unit 1100, an 
angle-measuring unit 1400, a storage unit 4200, a display 
unit 4300, a driving unit 4400, a control and arithmetic 
unit 4000, and an operations/input unit 5000. The storage 
unit 4200 is for storing data, programs, and the like. 
Using the display unit 4300 and the operations/ input unit 
5000 allows a user to operate the survey machine 1000. 

The electrical configuration is essentially the same 
as that of the first embodiment, except that the image 
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acquisition device 100 is included. Further detailed 
description of the electrical configuration is therefore 
omitted. 

Next, operation of the second embodiment is 
described hereunder in accordance with Fig. 9. 

First, in step S91, a target mark 2000a, 2000b, 
2000c, 2000d, 2000e, or 2000f is rested in at least six 
positions on an object to be measured (hereinafter, 
referred to as the measurement target 10000) . The six 
positions are taken as pass points. After being rested, 
the target marks are surveyed. 

In following step S92, the target marks 2000a to 
2 0 oof, together with the measurement target 10 0 00, are 
photographed from at least two directions (left/right) 
using digital cameras 3000. 

In next step S81, relative orientation is conducted 
using the collimation points (pass points) that were 
obtained in step S91. In S81, relationships between 
inclinations, scaling coefficients, and other parameters of 
the stereographic images acquired by the digital cameras 
3000 can be calculated from the pass points. 

Next, in step S82, deviation-correcting images are 
created to associate the pass points of the stereographic 
images. A projective transformation is conducted to create 
the deviation-correcting images in step S82. The 
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projective transformation refers to such a transformation 
in which photograph coordinates at a point on a light - 
receiving element of one digital camera 3000 are projected 
onto other planes. In this case, feature points are 
extracted from one image and then the other image is 
scanned for tie points on the same horizontal line. 

There is a need, therefore, to translate the digital 
cameras 3000 in a horizontal direction and transform images 
into the resulting images. That is to say, the images used 
need to be transformed into the images appearing as if they 
had been acquired by translating the digital cameras 3000. 
Such transformation makes it possible to search for tie 
points even in the images obtained by moving naturally the 
digital cameras 3000. Furthermore, pass points are 
generated manually or automatically in step S83 . 

In step S84, stereo matching is conducted. Stereo 
matching is a method for automatically searching for tie 
points in the two acquired images. 

In next step S85, the relationship in relative 
position between the digital cameras 3 000 that acquired the 
images from the respective (left/right) directions can be 
derived using the tie points that were searched for in step 
S84 . The above, in turn, makes it possible to define a 
three-dimensional coordinate system with an optical axis of 
the left camera as its center, and hence to define a three- 
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dimensional coordinate system with an optical axis of one 
digital camera 3000 as its center. 

Next, in step 386, the coordinate positions of the 
pass points that were obtained during surveying with the 
survey machine 1000 are assigned to .the model coordinate 
system that was obtained from the relative orientation, and 
then this model coordinate system is transformed into a 
terrestrial coordinate system by conducting absolute 
orientation . 

The absolute orientation here is an operation of 
transforming the model coordinate system that was obtained 
from the relative orientation, into a terrestrial 
coordinate system. The transformation can be conducted by 
assigning terrestrially measured three-dimensional 
coordinate data to the points on the images. 

In next step S87, data is transformed into three- 
dimensional data of the terrestrial coordinate system. The 
three-dimensional data can be used, for example, to display 
ortho- images that are to be expanded into terrestrial image 
form . 

The ortho- images are described here. Whereas the 
camera-obtained photographs are central projection 
photographs, the central projection photographs further 
generated by oblique orthogonal projection are called 
orthophotos . Each of the central projection photographs 
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was obtained through a lens. Unlike a scale of a map, 
therefore, that of the entire photograph is not uniform. 
The orthophotos, however, are uniform in scale since they 
were generated by oblique orthogonal projection, and can 
therefore be handled similarly to maps. 

The images acquired by the digital cameras 3000 are 
constructed from data of small pixel units, and coordinates 
are assigned to each of the pixels by relative orientation 
and absolute orientation. Two-dimensional displays on a 
display apparatus or the like are shaded according to 
three-dimensional coordinates. During coordinate 
conversion, coordinates in pixel units are newly calculated 
and then displayed in the form of operation such as 
rotation. 

As described above, the present embodiment relates 
to a three-dimensional survey system capable of making 
stereographic displays by computing three-dimensional 
coordinate data with the survey machine 1000 and the 
digital cameras 3000. 

The present invention thus constructed has: a survey 
apparatus for measuring a position of a collimation target 
from distance and angle data; image acquisition devices 
each for acquiring images of an object to be measured, 
inclusive of an image of the collimation target, from 
different plural directions; and' arithmetic processing 
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means that matches, by using the collimation target as a 
tie point, the images that have been acquired by the image 
acquisition devices, relates the collimation target 
position that has been measured by the survey apparatus, 
and the collimation target in each of the matched images, 
and computes three-dimensional coordinate data of the 
object to be measured, in accordance with above-related 
data . 

The present invention is therefore effective in that 
it can obtain three-dimensional coordinate data 
conveniently and accurately. 

Industrial Applicability 

The present invention relates to three-dimensional 
survey systems (and like systems) for computing three- 
dimensional coordinate data using a survey apparatus and 
image acquisition devices, and more particularly, to a 
three-dimensional survey system capable of making 
stereographic displays by determining positions of tie 
points using a survey apparatus. 



